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LOAD BALANCING BETWEEN MULTIPLE WEB 
SERVERS 

BACKGROUND OF THE INVENTION 

1. Related Applications. 

The present invention claims priority from U.S. 
Provisional Patent Application No. 60/197,490 entitled 
CONDUCTOR GATEWAY filed on April 17, 2000. 

2. Field of the Invention. 

The present invention relates, in general, to network 
information access and, more particularly, to software, 
systems and methods for serving web pages in a coordinated 
fashion from multiple cooperating web servers. 

3. Relevant Background. 

Increasingly, business data processing systems, 
entertainment systems, and personal communications systems 
are implemented by computers across networks that are 
interconnected by internetworks (e.g., the Internet). The 
Internet is rapidly emerging as the preferred system for 
distributing and exchanging data. Data exchanges support 
applications including electronic commerce , broadcast and 
multicast messaging, videoconferencing, gaming, and the 
like. 

The Internet is a collection of disparate computers 
and networks coupled together by a web of interconnections 
using standardized communication protocols. The Internet 
is characterized by its vast reach as a result of its wide 
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and increasing availability and easy access protocols. 
Unfortunately, the heterogenous nature of the Internet 
results in variable bandwidth and quality of service 
between points. The latency and reliability of data 
5 transport is largely determined by the total amount of 
traffic on the Internet and so varies wildly seasonally 
and throughout the day. Other factors that affect quality 
of service include equipment outages and line degradation 
that force packets to be rerouted, damaged and/or dropped. 
10 Also, routing software and hardware limitations within the 
Internet infrastructure may create bandwidth bottlenecks, 
even when the mechanisms are operating within 
specifications , 

Internet transport protocols do not discriminate 
15 between users. Data packets are passed between routers 
and switches that make up the Internet fabric based on the 
hardware's instantaneous view of the best path between 
source and destination nodes specified in the packet. 
Because each packet may take a different path, the latency 
2 0 of a packet cannot be guaranteed and, in practice, varies 
significantly. Likewise, data packets are routed through 
the Internet without any prioritization based on content. 

Prioritization has not been an issue with 
conventional networks such as local -area networks (LANs) 

2 5 and wide area networks (WANs) because the average latency 

of such networks has been sufficiently low and 
sufficiently uniform to provide acceptable performance. 
However, there is an increasing demand for network 
applications that cannot tolerate high and variable 

3 0 latency. This situation is complicated when the 

application is to be run over the Internet where latency 
and variability in latency are many times greater than in 
LAN and WAN environments. 
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A particular need exists in environments that involve 
multiple users accessing a network resource such as a web 
server. Examples include broadcast, multicast and 

videoconferencing as well as most electronic commerce (e- 
5 commerce) applications. In these applications, it is 
important to maintain a reliable connection so that the 
server and clients remain synchronized and information is 
not lost. 

In electronic commerce (e-commerce) applications, it 
10 is important to provide a satisfying buying experience 
that leads to a purchase transaction. To provide this 
high level of service, a web site operator must ensure 
that data is delivered to the customer in the most usable 
and efficient fashion. Also, the web site operator must 
15 ensure that critical data received from the customer is 
handled with priority. 

Until now, however, the e-commerce site owner has had 
little or no control over the transport mechanisms through 
the Internet that affect the latency and quality of 

20 service. This is akin to a retailer being forced to deal 
with a customer by shouting across the street, never 
certain how often what was said must be repeated, and 
knowing that during rush hour communication would be 
nearly impossible. While efforts are continually being 

25 made to increase the capacity and quality of service 
afforded by the Internet, it is contemplated that 
congestion will always impact the ability to predictably 
and reliably offer a specified level of service. 
Moreover, the change in the demand for bandwidth increases 

3 0 at a greater rate than does the change in bandwidth 
supply, ensuring that congestion will continue to be an 
issue into the foreseeable future. A need exists for a 
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system to exchange data over the Internet that provides a 
high quality of service even during periods of congestion. 

Many e-commerce transactions are abandoned by the 
user because system performance degradations frustrate the 
5 purchaser before the transaction is consummated. While a 
transaction that is abandoned while a customer is merely 
browsing through a catalog may be tolerable, abandonment 
when the customer is just a few clicks away from a 
purchase is highly undesirable. However, existing 

10 Internet transport mechanisms and systems do not allow the 
e e-commerce site owner any ability to distinguish between 

the "just browsing" and the "about -to -buy" customers. In 
J=y fact, the vagaries of the Internet may lead to the casual 

m browser receiving a higher quality of service while the 

15 about -to-buy customer becomes frustrated and abandons the 
:■: transaction. 

"Web sites are often implemented on a plurality of web 
jjl servers which may or may not be running on separate 

^ hosting machines. Each web server handles a set of 

2 0 content and some load distribution software runs on top of 

the multiple web servers to direct requests to the web 
server that can handle the request. The multiple servers 
essentially act as peers with each server having a set of 
resources from which it serves requests. It is difficult 
25 to distribute load efficiently amongst the multiple 
servers, however. One or more servers may experience 
heavy traffic while other servers remain essentially idle, 
unable to assist the overworked servers. This results in 
poor performance . 

3 0 Several load balancing solutions have been proposed 

for web sites including, for example, webQOS offered by 

Hewlett Packard Company. Another recent load balancing 

solution described in U.S. Patent 5,894,554 uses a set of 
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"page servers" to offload some page generation 
functionality from the originating web server. These page 
servers remain in the IP address domain of the originating 
web server and so are closely coupled to the web server 
5 itself. Such solutions implement a logical layer over all 
the available web servers that receive incoming requests 
and route the requests intelligently to available web 
servers at a rate that allows the web servers to operate 
more efficiently. However, these solutions are generally 

10 operative after a client request has been transported 
through the network and received at the web site and so do 
not affect load balancing through the network itself. 
Moreover, such solutions do not extend well to web servers 
that are geographically and/or toplogically distributed. 

15 A need exists for a load balancing mechanism that provides 
efficient load balancing throughout a communication 
network. 

Also, current load balancing techniques operate on a 
request -by- request basis and so cannot readily direct 

2 0 requests in a manner that balances load at a more abstract 
level over whole systems and web sites. Although in many 
cases web sites are implemented in a stateless fashion so 
that requests can be handled on a request -by -request 
basis, some optimization can be obtained by stateful 

25 sessions. A need exists for load balancing systems, 
methods and software that work cooperatively with a web 
site to balance load on other than a request -by- request 
basis . 

SUMMARY OF THE INVENTION 

30 Briefly stated, the present invention involves a 

system for load balancing in a network environment 
including a plurality of network resources coupled to a 
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network wherein at least some of the network resources 
provide redundant services. A client is coupled to the 
network and a gateway machine is coupled to the network in 
communication with the client. The gateway machine is 
configured to receive requests from the client, establish 
a communication channel through the network with a network 
resource specified by the client, and access the specified 
network resources to service the received client requests. 
The gateway machine includes or is coupled to mechanisms 
for selecting amongst providers of redundant services a 
particular provider for a received request so as to 
balance load amongst the plurality of resources providing 
redundant services . 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 illustrates a general distributed computing 
environment in which the present invention is implemented; 

FIG. 2 shows in block-diagram form significant 
components of a system in accordance with the present 
invention; 

FIG. 3 shows a domain name system used in an 
implementation of the present invention; 

FIG. 4 shows front -end components of FIG. 2 in 
greater detail; 

FIG. 5 shows back-end components of FIG. 2 in greater 
detail ; 

FIG. 6 shows a conceptual block diagram of the system 

of FIG. 2 in an alternative context; and 

FIG. 7, illustrates an alternative embodiment of the 
present invention . 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

The present invention is illustrated and described in 
terms of a distributed computing environment such as an 
enterprise computing system using, public communication 
5 channels such as the Internet, However, an important 
feature of the present invention is that it is readily 
scaled upwardly and downwardly to meet the needs of a 
particular application. Accordingly, unless specified to 
the contrary, the present invention is applicable to 
10 significantly larger, more complex network environments, 
including wireless network environments, as well as small 
network environments such as conventional LAN systems. 

In accordance with the present invention, load 
balancing is p erformed on the front -e nd, before a network 

15 connection . Prior systems load balance at the back-end 
after the connection, and cannot select a channel. One 
feature of the present invention is that it provides a way 
to improve use of multiple channels through the network. 
The load balancing decisions are made at an intermediary 

2 0 server that is located on the network topology at a 
location logically closer to the client or software 
application making the request than the web server itself. 
This enables the present invention to not only balance 
load amongst, multiple web servers in a web site hosting 

25 center, but also to balance lo ad across multiple availab le 
communication channels based on, for example, quality of 
service provided on the available channels. 

One feature of the present invention is that the 
front -end servers are in separate IP address domains from 
30 the originating web server. A redirection mechanism is 
enabled to select from a pool of available front -end 
servers and direct client request packets from the 
originating web server to a selected front-end server. 
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Preferably, the front -end server establishes and maintains 
an enhanced communication channel with the originating web 
server. By enhanced, it is meant that the channel offers 
improved quality of service, lower latency, prioritization 
5 services, higher security transport, or other features and 
services that improve upon the basic transport mechanisms 
(such as TCP) defined for Internet data transport. 

In this manner, the load balancing functionality can 
be performed before the request is launched across the 
10 public network. A front-end that is logically close to 
S the client process that is requesting service is selected 

1.^ from the pool of available front-end servers. The 

y selected front -end is configured to provide the enhanced 

|g channel to the originating web site using, for example, a 

i;-^' 15 back-end server. An enhanced channel may already exist 

and such existence may be a criteria used to select a 
y particular front-end server from the pool of front -end 

1=^ servers . 

=7' For purposes of this document, a web server is a 

2 0 computer or system of computers running server software 
coupled to the World Wide Web (i.e., "the web") that 
delivers or serv^es web pages. The web server has a unique 
IP address and accepts connections in order to seirvice 
requests by sending back responses. A web server differs 

2 5 from a proxy server or a g a t e way _ se rve r in that a web 

server has resident a set of resources (i.e., software 
programs, data storage capacity, and/or hardware) that 
enable it to execute programs to provide an extensible 
range of functionality such as generating web pages, 

3 0 accessing remote network resources, analyzing contents of 

packets, reformatting request/response traffic and the 
like using the resident resources. In contrast, a proxy 
simply forwards request/response traffic on behalf of a 
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client to resources that reside elsewhere, or obtains 
resources from a local cache if implemented. A web server 
in accordance with the present invention may reference 
external resources of the same or different type as the 
services requested by a user, and reformat and augment 
what is provided by the external resources in its response 
to the user. Commercially available web server software 
includes Microsoft Internet Information Server (IIS) , 
Netscape Net site. Apache, among others. Alternatively, a 
web site may be implemented with custom or semi-custom 
software that supports HTTP traffic. 

FIG. 1 shows an exemplary computing environment 100 
in which the present invention may be implemented. 
Environment 100 includes a plurality of local networks 
such as Ethernet network 102, FDDI network 103 and Token 
Ring network 104. Essentially, a number of computing 
devices and groups of devices are interconnected through a 
network 101. For example, local networks 102, 103 and 104 
are each coupled to network 101 through routers 109. LANs 
102, 103 and 104 may be implemented using any available 
topology and may implement one or more server technologies 
including, for example UNIX, Novell, or Windows NT 
networks, including both client -server and peer-to-peer 
type networks. Each network will include distributed 
storage implemented in each device and typically includes 
some mass storage device coupled to or managed by a server 
computer. Network 101 comprises, for example, a public 
network such as the Internet or another network mechanism 
such as a fibre channel fabric or conventional WAN 
technologies . 

Local networks 102, 103 and 104 include one or more 
network appliances 107. One or more network appliances 
107 may be configured as an application and/or file 

9 
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server. Each local network 102, 103 and 104 may include a 
number of shared devices (not shown) such as printers, 
file servers, mass storage and the like. Similarly, 
devices 111 may be shared through network 101 to provide 
5 application and file services, directory services, 
printing, storage, and the like. Routers 109 provide a 
physical connection between the various devices through 
network 101. Routers 109 may implement desired access and 
security protocols to manage access through network 101. 

10 Network appliances 107 may also couple to network 101 

through public switched telephone network 108 using copper 
or wireless connection technology. In a typical 

environment, an Internet service provider 106 supports a 
connection to network 101 as well as PSTN 108 connections 

15 to network appliances 107. 

Network appliances 107 may be implemented as any kind 
of network appliance having sufficient computational 
function to execute software needed to establish and use a 
connection to network 101. Network appliances 107 may 
2 0 comprise workstation and personal computer hardware 
executing commercial operating systems such as Unix 
variants, Microsoft Windows, Macintosh OS, and the like. 
At the same time, some appliances 107 comprise portable or 
handheld devices using wireless connections through a 

2 5 wireless access provider such as personal digital 

assistants and cell phones executing operating system 
software such as PalmOS, WindowsCE, and the like. 
Moreover, the present invention is readily extended to 
network devices such as office equipment, vehicles, and 

3 0 personal communicators that make occasional connection 

through network 101 . 

Each of the devices shown in FIG. 1 may include 
memory, mass storage, and a degree of data processing 

10 
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capability sufficient to manage their connection to 
network 101. The computer program devices in accordance 
with the present invention are implemented in the memory 
of the various devices shown in FIG. 1 and enabled by the 
5 data processing capability of the devices shown in FIG. 1. 
In addition to local memory and storage associated with 
each device, it is often desirable to provide one or more 
locations of shared storage such as disk farm (not shown) 
that provides mass storage capacity beyond what an 
10 individual device can efficiently use and manage. 
Selected components of the present invention may be stored 
;^ in or implemented in shared mass storage. 

W The present invention operates in a manner akin to a 

^ private network 2 00 implemented within the Internet 

IaJ 15 infrastructure. Private network 200 expedites and 

prioritizes communications between a client 205 and a web 
site 210. In the specific examples herein, client 205 
\^ comprises a network-enabled graphical user interface such 

i£j as a World Wide Web browser. However, the present 

^. 2 0 invention is readily extended to client software other 

than conventional web browser software. Any client 

application that can access a standard or proprietary user 
level protocol for . network access is a suitable 
equivalent. Examples include client applications for file 

2 5 transfer protocol (FTP) services, voice over Internet 

protocol (VoIP) services, network news protocol (NNTP) 
services, multi-purpose internet mail extensions (MIME) 
services, post office protocol (POP) services, simple mail 
transfer protocol (SMTP) services, as well as Telnet 

3 0 services. In addition to network protocols, the client 

application may access a network application such as a 
database management system (DBMS) in which case the client 
application generates query language (e.g., structured 
query language or "SQL") messages. In wireless 

11 
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appliances, a client application may communicate via a 
wireless application protocol (WAP) or the like. 

For convenience, the term "web site" is used 
interchangeably with "web server" in the description 
5 herein, although it should be understood that a web site 
comprises a collection of content, programs and processes 
implemented on one or more web servers. A web site is 
owned by the content provider such as an e- commerce vendor 
whereas a web server refers to set of programs running on 
10 one or more machines coupled to an Internet node. The web 
G site 210 may be hosted on the site owner's own web server, 

or hosted on a web server owned by a third party, A web 
Im hosting center is an entity that implements one or more 

m web sites on one or more web servers using shared hardware 

15 and software resources across the multiple web sites. In 
a typical .web infrastructure, there are many web browsers, 
each of which has a TCP connection to the web server in 
which a particular web site is implemented. The present 
zJ invention adds two components to the infrastructure: a 

^ 20 front-end 201 and back-end 203. Front-end 201 and back-end 

2 03 are coupled by a managed data communication link 2 02 
that forms, in essence, a private network. 

Front-end mechanism 2 01 serves as an access point for 

client-side communications. Front-end 201 implements a 

— 

25 Q atewav that functions as a proxy for the web server (s) 
implementing web site 210 (i.e., from the perspective of 
client 205, front-end 201 appears to be the web site 210) . 
Front-end 201 comprises, for example, a computer that sits 
"close" to clients 205. By "close", it is meant that the 

3 0 average latency associated with a connection between a 
client 205 and a front -end 201 is less than the average 
latency associated with a connection between a client 205 
and a web site 210. Desirably, front-end computers have 

12 
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as fast a connection as possible to the clients 205. For 
example, the fastest available connection may be 
implemented in point of presence (POP) of an Internet 
service provider (ISP) 106 used by a particular client 
5 2 05. However, the placement of the front -ends 2 01 can 
limit the number of browsers that can use them. Because 
of this, in some applications it is more practical to 
place one front -end computer in such a way that several 
POPs can connect to it. Greater distance between front- 
10 end 201 and clients 205 may be desirable in some 
applications as this distance will allow for selection 
O amongst a greater number front -ends 2 01 and thereby 

Jfe* provide significantly different routes to a particular 

\m back-end 203. This may offer benefits when particular 

;2 15 routes and/or front -ends become congested or otherwise 

unavailable, 

S ; ii 

Q Transport mechanism 2 02 is implemented by cooperative 

:^7- actions of the front-end 201 and back-end 203. Back-end 

ifi 2 03 processes and directs data communication to and from 

™ 20 web site 210. Transport mechanism 202 communicates data 

packets using a proprietary protocol over the public 
Internet infrastructure in the particular example. Hence, 
the present invention does not require heavy 
infrastructure investments and automatically benefits from 
2 5 improvements implemented in the general purpose network 
101. Unlike the general purpose Internet, front -end 2 01 
and back-end 2 03 are programmably assigned to serve 
accesses to a particular web site 210 at any given time. 

It is contemplated that any number of front -end and 
30 back-end mechanisms may be implemented cooperatively to 
support the desired level of service required by the web 
site owner. The present invention implements a many- to- 
many mapping of front-ends to back-ends. Because the 

13 
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front -end to back-end mappings can by dynamically changed, 
a fixed hardware infrastructure can be logically 
reconfigured to map more or fewer front -ends to more or 
fewer back-ends and web sites or servers as needed. 

5 Front-end 201 together with back-end 203 function to 

reduce traffic across the transport morphing protocol™ 
(TMP™) link 2 02 and to improve response time for selected 
browsers . Transport morphing protocol and TMP are 

trademarks or registered trademarks of Circadence 

10 Corporation in the United States and other countries. 
Traffic across the TMP link 202 is reduced by compressing 
data and serving browser requests from cache for fast 
retrieval. Also, the blending of request datagrams 
results in fewer request : acknowledge pairs across the TMP 

15 link 202 as compared to the number required to send the 
packets individually between front-end 201 and back-end 
203. This action reduces the overhead associated with 
transporting a given amount of data, although conventional 
request : acknowledge traffic is still performed on the 

20 links coupling the front-end 201 to client 205 and back- 
end 203 to a web server. Moreover, resend traffic is 
significantly reduced further reducing the traffic. 
Response time is further improved for select privileged 
users and for specially marked resources by determining 

2 5 the priority for each HTTP transmission. 

In one embodiment, front -end 201 and back-end 2 03 are 
closely coupled to the Internet backbone. This means they 
have high bandwidth connections, can expect fewer hops, 
and have more predictable packet transit time than could 

3 0 be expected from a general -purpose connection. Although 

it is preferable to have low latency connections between 
front-ends 201 and back-ends 203, a particular strength of 
the present invention is its ability to deal with latency 
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by enabling efficient transport and traffic 
prioritization. Hence, in other embodiments front -end 2 01 
and/or back-end 203 may be located farther from the 
Internet backbone and closer to clients 205 and/or web 
servers 210. Such an implementation reduces the number of 
hops required to reach a front -end 2 01 while increasing 
the number of hops within the TMP link 2 02 thereby 
yielding control over more of the transport path to the 
management mechanisms of the present invention. 

Clients 205 no longer conduct all data transactions 
directly with the web server 210. Instead, clients 205 
conduct some and preferably a majority of transactions 
with front-ends 201, which simulate the functions of web 
server 210. Client data is then sent, using TMP link 2 02, 
to the back-end 203 and then to the web server 210. 
Running multiple clients 2 05 over one large connection 
provides several advantages: 

• Since all client data is mixed, each client can be 
assigned a priority. Higher priority clients, or 
clients requesting higher priority data, can be 
given preferential access to network resources so 
they receive access to the channel sooner while 
ensuring low-priority clients receive sufficient 
service to meet their needs. 

• The large connection between a front -end 2 01 and 
back-end 2 03 can be permanently maintained, 
shortening the many TCP/IP connection sequences 
normally required for many clients connecting and 
disconnecting . 

Using a proprietary protocol allows the use of more 
effective techniques to improve data throughput and makes 

15 
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better use of existing bandwidth during periods when the 
network is congested. 

A particular advantage of the architecture shown in 
FIG. 2 is that it is readily scaled Any number of client 
5 machines 205 may be supported. In a similar manner, a web 
site owner may choose to implement a site using multiple 
web servers 210 that are co- located or distributed 
throughout network 101. To avoid congestion, additional 
front -ends 2 01 may be implemented or assigned to 

10 particular web sites. Client traffic is dynamically 
directed to available front-ends 201 to provide load 
balancing. Hence, when quality of service drops because 
of a large number of client accesses, an additional front- 
end 201 can be assigned to the web site and subsequent 

15 client requests directed to the newly assigned front -end 
201 to distribute traffic across a broader base. 

In the particular examples, this is implemented by a 
• front -end manager component 2 07 that communicates with 
multiple front-ends 201 to provide administrative and 

20 configuration information to front-ends 201. Each front- 
end 201 includes data structures for storing the 
configuration information, including information 

identifying the IP addresses of web servers 210 to which 
they are currently assigned. Other administrative and 

25 configuration information stored in front-end 201 may 
include information for prioritizing data from and to 
particular clients, quality of service information, and 
the like. 

Similarly, additional back-ends 203 can be assigned 
3 0 to a web site to handle increased traffic. Back-end 
manager component 2 09 couples to one or more back-ends 2 03 
to provide centralized administration and configuration 
service. Back-ends 2 03 include data structures to hold 

16 



\\\B0 - 80142/2001 - #16819 v5 



current configuration state, quality of service 
information and the like. In the particular examples 
front -end manager 2 07 and back-end manager 2 09 serve 
multiple web sites 210 and so are able to manipulate the 
5 number of front -ends and back-ends assigned to each web 
site 210 by updating this configuration information. When 
the congestion for the site subsides, the front -end 2 01 
and back-end 2 03 can be reassigned to other, busier web 
sites. These and similar modifications are equivalent to 
10 the specific examples illustrated herein. 

In the case of web-based environments, front -end 2 01 
is implemented using custom or off-the-shelf web server 
software. Front -end 201 is readily extended to support 
Iji other, non-web-based protocols, however, and may support 

j^J 15 multiple protocols for varieties of client traffic. 

IB Front-end 201 processes the data traffic it receives, 

regardless of the protocol of that traffic, to a form 
xp suitable for transport by TMP 202 to a back-end 203. 

^ Hence, most of the functionality implemented by front -end 

13 2 0 2 01 is independent of the protocol or format of the data 

received from a client 205. Hence, although the 

discussion of the exemplary embodiments herein relates 
primarily to front-end 201 implemented as a web server, it 
should be noted that, unless specified to the contrary, 
2 5 web-based traffic management and protocols are merely 
examples and not a limitation of the present invention. 

As shown in FIG. 2, in accordance with the present 
invention a web site is implemented using an originating 
web server 210 operating cooperatively with the web server 
30 of front-end 201. More generally, any network service 
(e.g., FTP, VoIP, NNTP, MIME, SMTP, Telnet, DBMS) can be 
implemented using a combination of an originating server 
working cooperatively with a front-end 201 configured to 
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provide a suitable interface (e.g., FTP , VoIP, NNTP, 
MIME, SMTP, Telnet, DBMS, WAP) for the desired service. 
In contrast to a simple front -end cache or proxy software, 
implementing a server in front -end 201 enables portions of 
5 the web site (or other network service) to actually be 
implemented in and served from both locations. The actual 
web pages or service being delivered comprises a composite 
of the portions generated at each server. Significantly, 
however, the web server in front -end 2 01 is close to the 

10 browser in a client 205 whereas the originating web server 
is close to all resources available at the web hosting 
center at which web site 210 is implemented. In essence 
the web site 210 is implemented by a tiered set of web 
servers comprising a front-end server 201 standing in 

15 front of an originating web server. 

This difference enables the web site or other network 
service to be implemented so as to take advantage of the 
unique topological position each entity has with respect 
to the client 205. By way of a particular example, assume 
20 an environment in which the front-end server 201 is 
located at the location of an ISP used by a particular set 
of clients 2 05. In such an environment, clients 2 05 can 
access the front -end server 2 05 without actually 
traversing the network 101. 

25 In order for a client 205 to obtain service from a 

front-end 201, it must first be directed to a front-end 
201 that can provide the desired service. Preferably, 
client 205 does not need to be aware of the location of 
front-end 201, and initiates all transactions as if it 

30 were contacting the originating server 210. FIG. 3 
illustrates a domain name server (DNS) redirection 
mechanism that illustrates how a client 2 05 is connected 
to a front-end 201. The DNS systems is defined in a 
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variety of Internet Engineering Task Force (IETF) 
documents such as RFC0883, RFC 1034 and RFC 1035 which are 
incorporated by reference herein. In a typical 

environment, a client 2 05 executes a browser 301, TCP/IP 
5 stack 303, and a resolver 305. For reasons of performance 
and packaging, browser 301, TCP/IP stack 303 and resolver 
3 05 are often grouped together as routines within a single 
software product . 

Browser 3 01 functions as a graphical user interface 
to implement user input/output (I/O) through monitor 311 
and associated keyboard, mouse, or other user input device 
(not shown) . Browser 3 01 is usually used as an interface 
for web-based applications, but may also be used as an 
interface for other applications such as email and network 
news, as well as special-purpose applications such as 
database access, telephony, and the like. Alternatively, 
a special -purpose user interface may be substituted for 
the more general -purpose browser 3 01 to handle a 
particular application. 

20 TCP/IP stack 303 communicates with browser 301 to 

convert data between formats suitable for browser 301 and 
IP format suitable for Internet traffic. TCP/IP stack 
also implements a TCP protocol that manages transmission 
of packets between client 205 and an Internet service 

25 provider (ISP) or equivalent access point. IP protocol 
requires that each data packet include, among other 
things, an IP address identifying a destination node. In 
current implementations the IP address comprises a 32 -bit 
value that identifies a particular Internet node. Non-IP 

30 networks have similar node addressing mechanisms. To 
provide a more user- friendly addressing system, the 
Internet implements a system of domain name servers that 
map alpha-numeric domain names to specific IP addresses. 
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This system enables a name space that provides a more 
consistent reference between nodes on the Internet and 
avoids the need for users to know network identifiers, 
addresses, routes and similar information in order to make 
5 a connection. 

The domain name service is implemented as a 
distributed database managed by domain name servers (DNSs) 
307 such as DNS_A, DNS_B and DNS_C shown in FIG. 3. Each 
DNS relies on <domain name:IP> address mapping data stored 

10 in master files scattered through the hosts that use the 
domain system. These master files are updated by local 
system administrators. Master files typically comprise 
text files that are read by a local name server, and hence 
become available through the name servers 3 07 to users of 

15 the domain system. 

The user programs (e.g., clients 205) access name 
servers through standard programs such as resolver 305. 
Resolver 3 05 includes an address of a DNS 3 07 that serves 
as a primary name server. When presented with a reference 

20 to a domain name (e.g., http://www.circadence.com), 
resolver 305 sends a. request to the primary DNS (e.g., 
DNS_A in FIG. 3) . The primary DNS 3 07 returns either the 
IP address mapped to that domain name, a reference to 
another DNS 307 which has the mapping information (e.g., 

25 DNS_B in FIG. 3) , or a partial IP address together with a 
reference to another DNS that has more IP address 
information. Any number of DNS-to-DNS references may be 
required to completely determine the IP address mapping. 

In this manner, the resolver 3 05 becomes aware of the 
30 IP address mapping which is supplied to TCP/IP component 
303. Client 205 may cache the IP address mapping for 
future use. TCP/IP component 303 uses the mapping to 
supply the correct IP address in packets directed to a 

20 
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particular domain name so that reference to the DNS system 
need only occur once per connection to a web site. 

In accordance with the present invention, at least 
one DNS server 307 is owned and controlled by system 
5 components of the present invention. When a user accesses 
a network resource (e.g., a web site), browser 301 
contacts the public DNS system to resolve the requested 
domain name into its related IP address in a conventional 
manner. In a first embodiment, the public DNS performs a 

10 conventional DNS resolution directing the browser to an 
originating server 210 and server 210 performs a 
redirection of the browser to the system owned DNS server 
(i.e., DNC_C in FIG. 3). In a second embodiment, 

domain : address mappings within the DNS system are modified 

15 such that resolution of the of the originating server's 
domain automatically return the address of the system- 
owned DNS server (DNS_C) . Once a browser is redirected to 
the system-owned DNS server, it begins a process of 
further redirecting the browser 301 to the best available 

2 0 front -end 2 01. 

Unlike a conventional DNS server, however, the 
system-owned DNS_C in FIG. 3 receives domain : address 
mapping information from a redirector component 309. 
Redirector 3 09 is in communication with front -end manager 
25 207 and back-end manager 209 to obtain information on 
current front -end and back-end assignments to a particular 
server 210. A conventional DNS is intended to be updated 
infrequently by reference to its associated master file. 
In contrast, the master file associated with DNS_C is 

3 0 dynamically updated by redirector 309 to reflect current 

assignment of front-end 201 and back-end 203. In 
operation, a reference to web server 210 (e.g., 
http://www.circadence.com) may result in an IP address 
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returned from DNS_C that points to any selected front -end 
201 that is currently assigned to web site 210. Likewise, 
web site 210 may identify a currently assigned back-end 
2 03 by direct or indirect reference to DNS_C. 

5 Front-end 201 typically receives information directly 

from front -end manager 2 07 about the address of currently 
assigned back-ends 203. Similarly, back-end 203 is aware 
of the address of a front-end 201 associated with each 
data packet. Hence, reference to the domain system is not 
10 required to map a front-end 201 to its appropriate back- 
end 2 03 . 

FIG. 4 illustrates principle functional components of 
an exemplary front-end 201 in greater detail. Primary 
functions of the front-end 201 include translating 
15 transmission control protocol (TCP) packets from client 
2 05 into TMP packets used in the system in accordance with 
the present invention. It is contemplated that the 

various functions described in reference to the specific 
examples may be implemented using a variety of data 

2 0 structures and programs operating at any location in a 

distributed network. For example, a front-end 201 may be 
operated on a network appliance 107 or server within a 
particular network 102, 103, or 104 shown in FIG. 1. The 
present invention is readily adapted to any application 
25 where multiple clients are coupling to a centralized 
resource. Moreover, other transport protocols may be 
used, including proprietary transport protocols. 

TCP component 401 includes devices for implementing 
physical connection layer and IP layer functionality. 

3 0 Current IP standards are described in IETF documents 

RFC0791, RFC0950, RFC0919, RFC0922, RFC792, RFC1112 that 
are incorporated by reference herein. For ease of 

description and understanding, these mechanisms are not 
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described in great detail herein. Where protocols other 
than TCP/IP are used to couple to a client 205, TCP 
component 401 is replaced or augmented with an appropriate 
network protocol process , 

5 TCP component 401 communicates TCP packets with one 

or more clients 205. Received packets are coupled to 
parser 402 where the IP layer information is extracted. 
TCP is described in IETF RFC0793, which is incorporated 
herein by reference. Each TCP packet includes header 
10 information that indicates addressing and control 
_ variables, and a payload portion that holds the user- level 

data being transported by the TCP packet. The user-level 
data in the payload portion typically comprises a user- 
level network protocol datagram. 

15 Parser 4 02 analyzes the payload portion of the TCP 

packet. In the examples herein, HTTP is employed as the 
user- level protocol because of its widespread use and the 
advantage that currently available browser software is 
able to readily use the HTTP protocol. In this case, 
2 0 parser 402 comprises an HTTP parser. More generally, 
parser 402 can be implemented as any parser-type logic 
implemented in hardware or software for interpreting the 
contents of the payload portion. Parser 4 02 may implement 
file transfer protocol (FTP) , mail protocols such as 

2 5 simple mail transport protocol (SMTP) , structured query 
language (SQL) and the like. Any user- level protocol, 
including proprietary protocols, may be implemented within 
the present invention using appropriate modification of 
parser 402 . 

3 0 To improve performance, front -end 2 01 optionally 
includes a caching mechanism 403. Cache 403 may be 
implemented as a passive cache that stores frequently 
and/or recently accessed web pages or as an active cache 
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that stores network resources that are anticipated to be 
accessed. In non-web applications, cache 4 03 may be used 
to store any form of data representing database contents, 
files, program code, and other information. Upon receipt 
5 of a TCP packet, HTTP parser 402 determines if the packet 
is making a request for data within cache 403. If the 
request can be satisfied from cache 403, the data is 
supplied directly without reference to web server 210 
(i.e., a cache hit). Cache 403 implements any of a range 

10 of management functions for maintaining fresh content. 
For example, cache 403 may invalidate portions of the 
cached content after an expiration period specified with 
the cached data or by web sever 210. Also, cache 403 may 
proactively update the cache contents even before a 

15 request is received for particularly important or 
frequently used data from web server 210. Cache 403 
evicts information using any desired algorithm such as 
least recently used, least frequently used, first in/first 
out, or random eviction. When the requested data is not 

2 0 within cache 403, a request is processed to web server 
210, and the returned data may be stored in cache 403. 

Several types of packets will cause parser 402 to 
forward a request towards web server 210. For example, a 
request for data that is not within cache 4 03 (or if 

2 5 optional cache 4 03 is not implemented) will require a 
reference to web server 210. Some packets will comprise 
data that must be supplied to web server 210 (e.g., 
customer credit information, form data and the like) . In 
these instances, HTTP parser 402 couples to data blender 

30 404. 

Optionally, front-end 201 implements security 
processes, compression processes, encryption processes and 
the like to condition the received data for improved 
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transport performance and/or provide additional 
functionality. These processes may be implemented within 
any of the functional components (e.g., data blender 404) 
or implemented as separate functional components within 
5 front-end 201. Also, parser 402 may implement a 

prioritization program to identify packets that should be 
given higher priority service. A prioritization program 
requires only that parser 4 02 include a data structure 
associating particular clients 205 or particular TCP 
10 packet types or contents with a prioritization value. 
Based on the prioritization value, parser 402 may 
O selectively implement such features. as caching, 

encryption, security, compression and the like to improve 
y performance and/or functionality. The prioritization 

!Lf 15 value is provided by the owners of web site 210, for 

W example, and may be dynamically altered, statically set, 

or updated from time to time to meet the needs of a 
P particular application. 

Blender 404 slices and/or coalesces the data portions 
□ 2 0 of the received packets into more desirable "TMP units" 

that are sized for transport through the TMP mechanism 
202. The data portion of TCP packets may range in size 
depending on client 2 05 and any intervening links coupling 
client 205 to TCP component 401. Moreover, where 

2 5 compression is applied, the compressed data will vary in 

size depending on the compressibility of the data. Data 
blender 404 receives information from front-end manager 
207 that enables selection of a preferable TMP packet 
size. Alternatively, a fixed TMP packet size can be set 

3 0 that yields desirable performance across TMP mechanism 

202. Data blender 404 also marks the TMP units so that 
they can be re-assembled at the receiving end. 
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Data blender 404 also serves as a buffer for storing 
packets from all clients 205 that are associated with 
front -end 2 01. Blender 4 04 mixes data packets coming into 
front -end 2 01 into a cohesive stream of TMP packets sent 
5 to back-end 203 over TMP link 202. In creating a TMP 
packet, blender 404 is able to pick and choose amongst the 
available data packets so as to prioritize some data 
packets over others . 

In an exemplary implementation, a "TMP connection" 
10 comprises a plurality of "TCP connection buffers", 
logically arranged in multiple "rings" . Each TCP socket 
maintained between the front-end 201 and a client 205 
corresponds to a TCP connection buffer. When a , TCP 
connection buffer is created, it is assigned a priority. 
15 For purposes of the present invention, any algorithm or 
criteria may be used to assign a priority. Each priority 
ring is associated with a number of TCP connection buffers 
having similar priority. In a. specific example, five 
priority levels are defined corresponding to five priority 
20 rings. Each priority ring is characterized by the number 
of connection buffers it holds (nSockets) , the number of 
connection buffers it holds that have data waiting to be 
sent (nReady) and the total number of bytes of data in all 
the connection buffers that it holds (nBytes) . 

2 5 When composing TMP data packets, the blender goes 

into a loop comprising the steps: 

1) Determine the number of bytes available to be sent 
from each ring (nBytes) , and the number of TCP connections 
that are ready to send (nReady) 

3 0 2) Determine how many bytes should be sent from each 

ring. This is based on a weight parameter for each 
priority. The weight can be thought of as the number of 

26 



\\\B0 - 80142/2001 - #16819 v5 



bytes that should be sent at each priority this time 
through the loop. 

3) The nSend value computed in the previous step 
reflects the weighted proportion that each ring will have 
5 in a blended TMP packet, but the values of nSend do not 
reflect how many bytes need to be selected to actually 
empty most or all of the data waiting to be sent a single 
round. To do this, the nSend value is normalized to the 
ring having the most data waiting (e.g., nBytes 
10 nSendNorm) . This involves a calculation of a factor: S = 
nBytes/ (Weight*nReady) for the ring with the greatest 
nReady. Then, for each ring, calculate nReady*S*Weight to 
get the normalized value (nSendNorm) for each priority 
ring. 

15 4) Send sub-packets from the different rings. This is 

done by taking a sub-packet from the highest priority ring 
and adding it to a TMP packet, then adding a sub-packet 
from each of the top two queues, then the top three, and 
so on. 

2 0 5) Within each ring, sub-packets are added round 

robin. When a sub-packet is added from a TCP connection 
buffer the ring is rotated so the next sub-packet the ring 
adds will come from a different TCP connection buffer. 
Each sub-packet can be up to 512 bytes in a particular 

2 5 example. If the connection buffer has less than 512 bytes 

waiting, the data available is added to the TMP packet. 

6) When a full TMP packet (roughly 1.5 kB in a 
particular example) is built, it is sent. This can have 
three or more sub packets, depending on their size. The 

3 0 TMP packet will also be sent when there is no more data 

ready . 
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TMP mechanism 4 05 implements the TMP protocol in 
accordance with the present invention. TMP is a TCP-like 
protocol adapted to improve performance for multiple 



5 TMP mechanism 4 05 and a corresponding back-end TMP 
mechanism 505 shown in FIG. 5 are computer processes that 



mechanism in accordance with the present invention creates 
and maintains a stable connection between two processes 
10 for high-speed, reliable, adaptable communication. 

TMP is not merely a substitute for the standard TCP 
environment. TMP is designed to perform particularly well 
in heterogeneous network environments such as the 
Internet. TMP connections are made less often than TCP 

15 connections. Once a TMP connection is made, it remains up 
unless there is some kind of direct intervention by an 
administrator or there is some form of connection breaking 
network error. This reduces overhead associated with 
setting up, maintaining and tearing down connections 

2 0 normally associated with TCP. 

Another feature of TMP is its ability to channel 
numerous TCP connections through a single TMP pipe 202. 
The environment in which TMP resides allows multiple TCP 
connections to occur at one end of the system. These TCP 

2 5 connections are then mapped into a single TMP connection. 

The TMP connection is then broken down at the other end of 
the TMP pipe 2 02 in order to traffic the TCP connections 
to their appropriate destinations. TMP includes 

mechanisms to ensure that each TMP connection gets enough 

3 0 of the available bandwidth to accommodate the multiple TCP 

connections that it is carrying. 

Another advantage of TMP as compared to traditional 
protocols is the amount of information about the quality 



channels operating over a single connection. 



Front -end 



implement the end points of TMP link 202. 



The TMP 
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of the connection that a TMP connection conveys from one 
end to the other of a TMP pipe 202. As often happens in a 
network environment, each end has a great deal of 
information about the characteristics of the connection in 
5 one direction, but not the other. By knowing about the 
connection as a whole, TMP can better take advantage of 
the available bandwidth. 

In contrast with conventional TCP mechanisms, the 
behavior implemented by TMP mechanism 405 is constantly 

10 changing. Because TMP obtains bandwidth to host a 

variable number of TCP connections and because TMP is 
responsive to information about the variable status of the 
network, the behavior of TMP is preferably continuously 
variable. One of the primary functions of TMP is being 

15 able to act as a conduit for multiple TCP connections. As 
such, a single TMP connection cannot behave in the same 
manner as a single TCP connection. For example, imagine 
that a TMP connection is carrying 100 TCP connections. At 
this time, it loses one packet (from any one of the TCP 

20 connections) and quickly cuts its window size in half (as 
specified for TCP) . This is a performance reduction on 
100 connections instead of just on the one that lost the 
packet . 

Each TCP connection that is passed through the TMP 
2 5 connection must get a fair share of the bandwidth, and 
should not be easily squeezed out. To allow this to 
happen, every TMP becomes more aggressive in claiming 
bandwidth as it accelerates. Like TCP, the bandwidth 
available to a particular TMP connection is measured by 
30 its window size (i.e., the number of outstanding TCP 
packets that have not yet been acknowledged) . Bandwidth 
is increased by increasing the window size, and 
relinquished by reducing the window size. Up to protocol 
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specified limits, each time a packet is successfully 
delivered and acknowledged, the window size is increased 
until the window size reaches a protocol specified 
maximum. When a packet is dropped (e.g., no acknowledge 
5 received or a resend packet response is received) , the 
bandwidth is decreased by backing off the window size. 
TMP also ensures that it becomes more and more resistant 
to backing off (as compared to TCP) with each new TCP 
connection that it hosts. A TMP should not go down to a 
10 window size of less than the number of TCP connections 
that it is hosting. 

In a particular implementation, every time a TCP 
connection is added to (or removed from) what is being 
passed through the TMP connection, the TMP connection 

15 behavior is altered. It is this adaptation that ensures 
successful connections using TMP. Through the use of the 
adaptive algorithms discussed above, TMP is able to adapt 
the amount of bandwidth that it uses. When a new TCP 
connection is added to the TMP connection, the TMP 

20 connection becomes more aggressive. When a TCP connection 
is removed from the TMP connection, the TMP connection 
becomes less aggressive. 

TMP pipe 2 02 provides improved performance in its 
environment as compared to conventional TCP channels, but 

2 5 it is recognized that TMP pipe 2 02 resides on the open, 

shared Internet in the preferred implementations. Hence, 
TMP must live together with many protocols and share the 
pipe efficiently in order to allow the other transport 
mechanisms fair access to the shared communication 

3 0 bandwidth. Since TMP takes only the amount of bandwidth 

that is appropriate for the number of TCP connections that 
it is hosting (and since it monitors the connection and 
controls the number of packets that it puts on the line) , 
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TMP will exist cooperatively with TCP traffic. 
Furthermore, since TMP does a better job at connection 
monitoring than TCP and TMP is better suited to throughput 
and bandwidth management than TCP . 

5 Also shown in FIG. 4 are data filter component 406 

and HTTP reassemble component 4 07 that process incoming 
(with respect to client 205) data. TMP mechanism 405 
receives TMP packets from TMP pipe 2 02 and extracts the 
TMP data units. Using the appended sequencing 

10 information, the extracted data units are reassembled into 
HTTP data packet information by HTTP reassembler 407. 
Data filter component 406 may also implement data 
decompression where appropriate, decryption, and handle 
caching when the returning data is of a cacheable type. 

15 FIG. 5 illustrates principle functional components of 

an exemplary back-end 203 in greater detail. Primary 
functions of the back-end 203 include translating 
transmission control protocol (TCP) packets from web 
server 210 into TMP packets as well as translating TMP 

2 0 packets received from a front -end 2 01 into the one or more 

corresponding TCP packets to be send to server 210. 

TMP unit 505 receives TMP packets from TMP pipe 2 02 
and passes them to HTTP reassemble unit 507 where they are 
reassembled into the corresponding TCP packets . Data 
25 filter 506 may implement other functionality such as 
decompression, decryption, and the like to meet the needs 
of a particular application. The reassembled data is 
forwarded to TCP component 501 for communication with web 
server 210 . 

3 0 TCP data generated by the web server process are 

transmitted to TCP component 501 and forwarded to HTTP 
parse mechanism 502 . Parser 502 operates in a manner 
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analogous to parser 4 02 shown in FIG. 4 to extract the 
data portion from the received TCP packets, perform 
optional compression, encryption and the like, and forward 
those packets to data blender 504. Data blender 504 
5 operates in a manner akin to data blender 4 04 shown in 
FIG. 4 to buffer and prioritize packets in a manner that 
is efficient for TMP transfer. Priority information is 
received by, for example, back-end manager 209 based upon 
criteria established by the web site owner. TMP data is 
10 streamed into TMP unit 5 05 for communication on TMP pipe 
202 . 

in 

,S Returning again to FIG. 2, in a particular example, 

|3 each front-end servers 201 will each maintain persistent 

i s ~ 

connections to a number of back-ends, each of which is 
W 15 associated with a destination server. Front-ends 201 

maintain a list of alternate connection addresses for 
L. back-ends 203 that support various destination sites. 

,p These alternate connections can be initiated when traffic 

J~ on another route to the same destination site has reached 

B 2 0 capacity, when the connection route used by the current 

connection has deteriorated to the point that user 
performance is degraded beyond a specified acceptable 
limit, based on quality of seirvice monitoring of the 
connection, or when the alternate route is expected to 
25 provide better Quality of Service (QOS) . QOS monitoring 
comprises, for example, monitoring the percentage of lost 
packets and round trip time (e.g., time elapsed between 
sending a packet and receive an acknowledge packet) . In a 
first case both routes will be used simultaneously, with 
3 0 the front -end 2 01 performing load balancing using 
performance data reported from the protocol QOS reporting 
functionality and considering current and expected loads 
on each route. 
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FIG. 6 illustrates an alternative embodiment in which 
the load balancing functionality is implemented in a 
single intermediary server 601 located at a front-end 
(e.g., on the client side of network 101). In an example 
5 operation shown in FIG. 6, front -end 601 may be supported 
in a network service provider's location 602. Front-end 
601 supports each web server 610 that together implement a 
particular web site such as web site 210 shown in FIG. 2. 
Each front-end 601 may support multiple web sites as well, 

10 although multiple web site support is not shown for ease 
of description and understanding. Each web server 610 may 
have its own globally unique network address and so be 
directly accessible via network 101. Alternatively, one 
or more servers 610 may be coupled together by a WAN or 

15 LAN having private addresses so that connections must be 
funneled through a single access point. 

QOS monitor 604 monitors the channel (s) between 
front-end 601 and each web server 610. Additionally, 
front-end 601 may have a preselected high water mark value 

2 0 indicating a maximum number of connections that can be in 
flight to a given web server 610. In yet another 
alternative, front-end 601 may conduct in-band or out-of- 
band communication with web servers 610 to determine their 
status with respect to current load. In any case, front- 

25 end 601 uses the QOS and server load information to select 
channels through network 101. 

In a particular example, some or all of web servers 
610 provide some set of redundant services such that a 
given request may be satisfied by more than one server 
30 610. Front-end 601 selects which of the capable servers 
610 to send a particular request based upon the server 
load availability and/or QOS data. 
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In another example, front -end 601 receives and 
buffers multiple requests for services directed to web 
servers 610. The buffered requests may come from a single 
client or from multiple browser clients 605. Front-end 
5 601 selects buffered requests for transmission across 
network 101. In accordance with the present invention, 
the order in which buffered requests are selected is 
determined, at least in part, by the requirements of load 
balancing amongst the multiple available web servers 610. 
10 In other words, if a front-end 601 holds buffered requests 
for two web servers 610, preference will be given to 
launching requests to an non-busy server while a buffered 
request to a busy server may remain in the buffer for a 
longer time. 

15 FIG. 7 illustrates an alternative implementation in 

which load balancing functionality is implemented in a 
single intermediary server 701 located at the back-end 
(e.g., the server side of network 101). Back-end server 
701 receives requests from a variety of clients and/or 

20 front-end web servers 201. Some or all of web servers 610 
provide a set of redundant services such that a given 
request may be satisfied by more than one server 610. 
back-end 701 selects which of the capable servers 610 to 
send a particular request based upon the server load 

2 5 and/or QOS data. Back-end 701 can directly monitor server 

load as it is aware of how many requests are pending at 
any particular serve 610. Moreover, back-end 701 can be 
programmed to be aware of the capabilities of each web 
server 610. Hence, when the number of outstanding 

3 0 requests to a particular server reaches a preselected high 

water mark, requests can be routed to other servers 610. 

Preferably, back-end server 701 routes requests based 
not only on volume, but also based on type of request. 
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Requests for database access, multimedia content delivery, 
dynamic web page generation, and static web page delivery 
vary significantly on the resource load of a server. 
Back-end server 701 monitors the type of request being 
5 made based upon, for example, header information in the 
received packet and/or information determined by parsing 
the request itself. Using this information, a server with 
no pending multimedia requests may be favored over an 
alternative server 610 with one or two pending multimedia 
10 requests. 

As shown in FIG. 7, back-end 701 may include a 

: 

queuing data structure 702 . Queue 702 holds requests so 
that they can be applied to servers 610 in a manner that 

m improves performance of server 610. The size, timing, and 

15 type of request may be used to determine when a request is 
released from queue 702 and applied to a server 610. 

Jl^^ Also, requests can be queued to maintain a substantially 

consistent number of pending requests to any given server 
610 to improve performance of that server. 

2 0 In any of the load balancing implementations 

disclosed herein, the load balancing decision (i.e., which 
server will receive a given request) can be made not only 
based upon relative load of the available servers, but 
also based upon other criteria. These other criteria 

2 5 might be, for example, which available server has the 

freshest content- Sometimes mirrored web sites, for 
example, have a disparity between mirror copies such that 
some are maintained more frequently than others. The load 
balancing web servers in accordance with the present 

3 0 invention, are capable of selecting amongst the mirrors by 

using knowledge of which mirror is designed to have the 
freshest contentment. Hence, the "original" web site may 
be given a disproportionate volume of traffic from a pure 
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load balancing standpoint up until it is unable to 
efficiently process the volume of requests. After this 
point is reached, the mirror sites may be used. 

Although the invention has been described and 
5 illustrated with a certain degree of particularity, it is 
understood that the present disclosure has been made only 
by way of example , and that numerous changes in the 
combination and arrangement of parts can- be resorted to by 
those skilled in the art without departing from the spirit 
10 and scope of the invention, as hereinafter claimed. For 
example, while devices supporting HTTP data traffic are 
Jr., used in the examples, the HTTP devices may be replaced or 

ffl augmented to support other public and proprietary 

in protocols and languages including FTP, NNTP, SMTP, SQL and 

15 the like. In such implementations the front-end 201 
vQ and/or back-end 203 are modified to implement the desired 

protocol. Moreover, front-end 201 and back-end 203 may 

,p support different protocols and languages such that the 

ill. 

front-end 201 supports, for example, HTTP traffic with a 
O 2 0 client and the back-end supports a DBMS protocol such as 

SQL, Such implementations not only provide the advantages 
of the present invention, but also enable a client to 
access a rich set of network resources with minimal client 
software . 
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